. Information , Bias , and Efficiency in Expert Evaluation :

نویسنده

  • Danielle Li
چکیده

Experts may have more information about the potential of projects in their area, but may also be biased. This paper develops a framework for separately identifying the effects of bias and information on expert evaluation and applies it in the context of peer review at the National Institutes of Health (NIH). I find that while reviewers are biased in favor of applications from their own subfield, they are also more informed about their quality. On net, the benefits of information tend to dominate, indicating that policies designed to reduce conflicts of interest may also reduce the quality of funding decisions. ∗I am very grateful to Pierre Azoulay, Michael Greenstone, and especially David Autor, for detailed feedback on this project. I also thank Jason Abaluck, Daron Acemoglu, Leila Agha, Josh Angrist, David Berger, David Chan, Esther Duflo, Brigham Frandsen, Richard Freeman, Bob Gibbons, Nathan Hendren, Xiao Yu May Wang, Ziad Obermeyer, Amanda Pallais, Chris Palmer, Michael Powell, Pian Shu, Scott Stern, Heidi Williams, and numerous participants at Berkeley Haas, Boston University, Columbia GSB, Dartmouth, Harvard Business School, Harvard Kennedy School, the London School of Economics, MIT, the NBER Productivity Lunch, and Northwestern Kellogg, for helpful comments and suggestions. I am grateful to George Chacko, Raviv Murciano-Goroff, Joshua Reyes, and James Vines for assistance with data. All errors are my own. †[email protected]

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Evaluation of the Effect of Presence of Health Information Technology Expert on Medical Records of Patients Admitted to Fatemeh Zahra Hospital, Sari, Iran

Background: Documenting medical records plays an important role in treatment and prevention. The purpose of this study was to evaluate the impact of the presence of health information technology experts in clinical wards on the documentation of hospital admissions files. Methods: In this descriptive cross-sectional study, 96 inpatient records in 2014 and 96 inpatient records in Fatemeh Zahra H...

متن کامل

Interpreting Ambiguous Social Situations in Social Anxiety: Application of Computerized Task Measuring Interpretation Bias

Background and Aims: The interpretation bias which is an important factor in the pathology of social anxiety disorder, has been recently considered in therapeutic approaches. Given the importance of interpretation bias in the treatment of social anxiety, and despite the ambiguity in the relationship between social anxiety and interpretation bias, we compared the interpretation bias in individua...

متن کامل

Providing A Model for Management Earnings Forecast Bias

Despite The Important Role That Management Profit Forecasting Plays In The Decision Making Of Capital Market Actors, These Predictions Appear To Be Biased. In The Attempt To Measure The Bias Of Predicting Profit Management, Numerous One- Dimensional Measurement Tools Have Been Proposed In The Accounting And Finance Literature. Despite These Efforts, No Comprehensive Composite Index Has Been Dev...

متن کامل

Mitigating Evidentiary Bias in Planning and Policy-Making; Comment on “Reflective Practice: How the World Bank Explored Its Own Biases?”

The field of cognitive psychology has increasingly provided scientific insights to explore how humans are subject to unconscious sources of evidentiary bias, leading to errors that can affect judgement and decision-making. Increasingly these insights are being applied outside the realm of individual decision-making to the collective arena of policy-making as well. A recent editorial in this jou...

متن کامل

Framing Bias in the Interpretation of Quality Improvement Data: Evidence From an Experiment

Background A growing body of public management literature sheds light on potential shortcomings to quality improvement (QI) and performance management efforts. These challenges stem from heuristics individuals use when interpreting data. Evidence from studies of citizens suggests that individuals’ evaluation of data is influenced by the linguistic framing or context of that information an...

متن کامل

Confirmation Bias in Web-Based Search: A Randomized Online Study on the Effects of Expert Information and Social Tags on Information Search and Evaluation

BACKGROUND The public typically believes psychotherapy to be more effective than pharmacotherapy for depression treatments. This is not consistent with current scientific evidence, which shows that both types of treatment are about equally effective. OBJECTIVE The study investigates whether this bias towards psychotherapy guides online information search and whether the bias can be reduced by...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011